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ABSTRACT 


Statistical cost control decisions may be based on two 
competing decision models. The Markovian Control model con- 
trols a process by investigating the process whenever the 
reported cost exceeds a fixed critical limit. The Bayesian 
Control model controls a process by using the reported cost 
to update the probability of the process being in-control and 
investigate the process whenever such posterior probability 
is less than a fixed critical value. 

This paper compares the relative effectiveness of the two 
models by a simulation analysis. It is observed that the 
Markovian Control model performs as well as or better than 
the Bayesian Control model unless the cost distribution of 
the in-control state is more dispersed than that of the out- 
of-control state. It is also observed that the relative 
effectiveness of the Markovian Control model compared to the 
Bayesian Control increases as the savings from an investiga- 
tion increases when the cost distribution of the in-control 


state is less dispersed than that of the out-of-control state. 





te 


Hen. 


eel. 


iy 


TABLE OF CONTENTS 


INTRODUCTION --------------------------------=--+ 
A. BACKGROUND ---9-------2-------2-------------- 


B. ISSUES IN COST VARIANCE INVESTIGATION 
DECISIONS ------------ 29-22 = - - - = - = - 


C. OBJECTIVE AND SCOPE OF THE STUDY ---------- 
D. METHODOLOGY -------------------- 


DESCRIPTION OF COST VARIANCE INVESTIGATION 
METHODS 9-2-2229 222 2 


A. MARKOVIAN CONTROL METHOD ------------------ 
B. BAYESIAN CONTROL METHOD ------------------- 
C. DISTINCTION BETWEEN TWO METHODS erre-rr----- 
DESCRIPTION OF SIMULATION MODEL --------------- 
A. DECISION-MAKING ENVIRONMENT --------------- 


B. PROBABILITY DISTRIBUTIONS OF IN-CONTROL 
AND OUT-OF-CONTROL STATES ----------------- 


C. BOUNDARY CONDITIONS BETWEEN OUT-OF-CONTROL 
AND IN-CONTROL STATE ------ 9225-25 5e%5%"%5%"°"-°7- 


D. SAVINGS FROM AN INVESTIGATION ------------- 
E. SUMMARY OF CONDITIONS SIMULATED ----------- 
F. SIMULATION PROCEDURE ---------------------- 
DISCUSSION OF RESULTS --------------<----------- 


A. EQUALLY DISPERSED IN-CONTROL AND OUT-OF- 
CONTROL STATE WITH LOW DEGREE OF OVERLAP -- 


Doe eECONTROL STATE LESS DISPERSED THAN 
OUT-OF-CONTROL STATE ---------23"%"%"%"°%"------ 


C. IN-CONTROL STATE MORE DISPERSED THAN 
OUT-OF-CONTROL STATE --------92%2%3"%2%-°------- 


10 
14 


es 


le 
iy 
24 
30 
53 


So 


34 


39 
40 
40 
40 


42 


46 








DE PaOUREnLY DESPERSED IN-CONTROL AND OUT-OF- 
CONTROL STATE WITH LARGE DEGREE OF OVERLAP --- 48 


E. NORMAL DISTRIBUTION WITH SMALL DISPERSION 
IN IN-CONTROL STATE AND GAMMA DISTRIBUTION 
IN OUT-OF-CONTROL STATE ---------------------- 49 


F. NORMAL DISTRIBUTION WITH LARGE DISPERSION IN 
IN-CONTROL STATE AND GAMMA DISTRIBUTION IN 


eee ro 5.405. —-——-—————————--——————----—--— 50 

Peco ommeeeronts Of THE PROCESS s=----9--<<-------- on 

vy. ee ee en OS SS 5S 
meee xAeA. se ROCEDURES OF THE SIMULATION MODEL <-------- 56 
eee ee eee ore RP ROGRAMS  s--- essere reer a2 
een) CEE et Gen) i em me ee ae en ee = == - = 78 
Pee eee ee nOn LL ST seen mm nn en en een 80 





LIST OF FIGURES 


Error of Decision -------<<<<-<-<--------—-.—----— 
A Controlled (Markov) Process ------------------ 
Cost Distributions --------------.--.........--- 


Illustration of Bayes' Theorem for 
Revised Probability ---------------------------- 


Equally Dispersed Low Overlap ------------------ 
In-Control Less Dispersed than Out-of-Control -- 
In-Control More Dispersed than Out-of-Control -- 
Equally Dispersed Large Overlap ---------------- 
Gamma (y,l) Distributions --------------------- 


Narrow Normal In-Control and Gamma Out-of- 
Contro] www wen re oe re rn a 


Wide Normal In-Control and Gamma Out-of- 
Control] wenn nn on an a a a a 


Relationship Between X and L(B) --------------- 
Relationship Between X and L(C) --------------- 
Relationship Between X and L(D) --------------- 
Relationship Between X_ and L(E) --------------- 
Relationship Between X_ and L(F) --------------- 


Flow Chart -----37--------- = a 


12 
Zi 


28 


Zo 
52 
3 
36 
36 


By 


38 





Table 


LISTSOFPSTABLES 


General Payoff Matrix 


18 Different Data Points Considered ---------- 
Cees eae noe toi 
95% Confidence Interval of x, ee ee 


Means of Cost Reports 


ZO 


41 


43 


45 


a 





I. INTRODUCTION 


A. BACKGROUND 

Financial planning and control rely heavily on standard 
costs or budgets as the principal tool for aiding decision 
making. Performance reports typically include a comparison 
of actual cost incurred and amount budgeted or allowed. 
Variations in cost performance can be expected in virtually 
every case. The variation may be caused by random variation 
or non-random variation. Random variation is a deviation be- 
tween actual and expected cost arising from the stochastic 
operation of some correctly specified relationships between 
variables. The stochastic nature means that the actual cost 
is subject to fluctuations because of random variations beyond 
management's control. Non-random variation is a deviation in 
cost performance caused by factors over which the manager or 
his superior has some control. 

Non-random variation can be corrected by investigating the 
cost generating process to identify the causal factors for 
corrective decisions. But no one advocates taking action and 
investigating every cost variance that occurs each period. 
Managers recognize that many variances are insignificant and 
caused by random, non-controllable factors. Since any inves- 
tigation will involve a certain expenditure of effort and 
funds, managers should attempt to take investigation and 


corrective action only when the cost variation is significant 





and controllable. Furthermore an investigation should be 
undertaken only if the benefits expected from the investiga- 
tion exceed the costs of searching for and correcting the 
source of cost variance. 

Therefore, a control problem in the cost management is 
to establish a control policy according to which a cost 
generating process shall be investigated to see if correc- 


tive action is necessary or economic. 


B. ISSUES IN COST VARIANCE INVESTIGATION DECISIONS 

several researchers have attempted to develop cost vari- 
ance investigation decision models by using a statistical 
approach. The basic idea of these approaches came from the 
statistical quality control concept in which it is assumed 
that some random variations in cost performance are available 
and should be specifically taken into consideration in making 
decisions about investigation of variances. 

Since a manager wants to control the cost generating pro- 
cess, he should decide when a variance is worthy of investiga- 
tion. If the variance resulted from non-controllable factors, 
or if future operations would not improve even if the cause 
of the variance was determined, he would prefer not to waste 
time and money investigating such variances. On the other 
hand, if investigation will result in substantial future sav- 
ings and more efficient operation, he will probably want the 
variance investigated. For deciding whether to investigate 


the process or not, the manager's available information consists 
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of some prior knowledge about the process and a cost report 
which was generated from the process. Therefore, in deciding 
whether to investigate a variance of the cost report, the 
following factors should be considered [1]. 

a. The probability that the variance resulted from the 
random, non-controllable causes. 

b. The reward which will result if the variance is investi- 
gated together with the associated probability of this reward. 

Smecost Of investigation. 

It is presumed that the costs generated from the process 
have some kind of probability distribution regardless of the 
cause of the deviations and that different causes will result 
gn different probability distributions in cost performance. 
Attributing to the characteristics of probability, a decision 
maker always associates some probability of errors (which are 
called type I and type II error) with his judgment about whether 
a cost variance is caused by random factors. If the distribu- 
tions of costs which may be caused by controllable or non- 
controllable factors are normal distributions, these errors 
can be explained as in Figure l-l. 

In Figure 1-l, we can say that the left side probability 
Baas outlon functlon (D.d.£.) is the p.d.£. of costs in “in- 
control" state, a desirable state, and the right side p.d.f. 
is the p.d.f£. of costs in "out-of-control" state, an undesir- 
able state which needs investigation. We assume that the 
process under consideration exists in either in-control state 


or out-of-control state. The type I error means that the 


el 





cost distribution caused cost distribution caused 


by non-controllable by controllable factors 
actors 


H x U5 
Type I (control, type it 
error limit error 


Figure l-l: Error of Decision 


manager decides not to investigate the process when the 
actual state is out-of-control; thus it causes loss of poten- 
tial savings from investigation. The type II error means that 
the manager decides to investigate the process when the actual 
state is in-control; thus the cost of investigation is wasted. 
Therefore, the manager has to figure out what control 
Pmmte Or Control criteria (in the figure the control limit xX) 
can minimize those costs (loss and waste). All statistical 
approaches to cost control decisions are aimed at finding 
these control criteria. 
The statistical control methods can be classified into 
two types: (1) the Markovian control method and (2) Bayesian 
control method. Both types suggested setting control limits 


on which the manager decides whether or not to investigate 
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the process when a cost report from the process is available. 
The underlying objective in both cases is to minimize long 
run expected incremental cost (waste and loss) or maximize 
savings from investigation (cost reduction minus incurred 
cost for the investigation). 

The Markovian Control method was suggested in the article 
"Cost Variance Investigation; Markovian Control of Markov 
Process" [2], by Dittman and Prakash in 1978. Under this 
method, the cost variance investigation decision is dependent 
on one critical limit which minimizes the cost of the process 
and can be computed by trial and error. 

The Bayesian control was suggested in the article "The 
Investigation of Cost Variance" [3], by Dykman in 1969. Under 
this method, the cost variance investigation decision is de- 
termined by the critical probability which is a function of 
all incremental costs involved. 

The two statistical approaches found in the literature 
do not always result in the same investigate/do-not-investi- 
gate decision. A question arises as to which model will lead 
to the optimal decisions. Using an analytic approach, Dittman 
and Prakash maintained that their Markovian control model is 
more effective than the Bayesian control model. However, the 
real test of the relative effectiveness of each model under 
different conditions remained to be seen. As Kaplan [4] puts 
it, "the final judgment on the appropriateness of formal sta- 
tistical and mathematical methods for cost variance analysis 


must be based on empirical studies" [4: p. 312). Inan empirical 
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study, Magee [5] implemented a simulation analysis of various 
cost variance investigation methods, but he didn't study the 
Markovian control method for it was not yet known. He justi- 
fied simulation by saying that "the simulation analysis is 
generally preferable to use analytic methods to find the 
properties of alternative decision models, when such methods 
are feasible. By using the same sequence of random numbers, 
the various cost investigation models can be tested on similar 
cost data, facilitating comparisons among models" [5: p. 532]. 
Simulation is a dynamic representation of the real world 
achieved by building a model and moving it through time. [In 
a Simulation, we can control many features. For comparison 
of two cost variance investigation methods, we can simulate 
Various combination of situations in the in-control state and 
out-of-control state. Simple Monte Carlo simulation can be 
a useful tool for comparison of two cost variance investiga- 


tion methods. 


See oewed 1 VE AND SCOPE OF THE STUDY 

The purposes of this paper are to develop a simulation 
model for the purpose of comparing the relative effectiveness 
of the two cost variance investigation methods and to evaluate 
the effectiveness of the two cost variance investigation 
methods. 

To compare the best Markovian control with the best 
Bayesian control, the optimal critical limit for the Markovian 


control method and optimal critical probability for the Bayesian 
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control method must be derived. It is not too complicated to 
calculate the optimal critical limit, but the calculation of 
optimal critical probability is too complicated to be applied 
in the real world. A dynamic programming for calculating this 
critical probability was suggested by Kaplan [6]. But this 
calculation is beyond the scope of this paper. Instead of 
optimal critical probability, the breakeven probability, which 
1s calculated from long-run expected savings and investigation 
cost, is used in this paper. lLong-run expected savings may 

be estimated from the historical data. The estimation can be 
made by the method suggested by Duvall{8]. 

In this paper, it is assumed that the long-run expected 
Savings were given as an external input to the simulation 
model. 

The scope of this study is confined the comparison of the 
relative effectiveness of the two cost variance investigation 
methods. Whether or not a manager should use one of these 
two methods is a separate question and is not the subject of 
this study. There are several necessary assumptions underlying 
the two methods. These assumptions are not tested in this 


study. 


D. METHODOLOGY 

The approach taken in this paper to test the relative effec- 
tiveness of these two models is to (1) examine the procedures 
of each of the two methods by studying relevant articles, 


(2) simulate these procedures, (3) incorporate these procedures 
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into the simulation model, (4) transfer this model to com- 
puter program and run the program and (5) analyze the results. 
This study 1s organized into five chapters; Chapter One 
presents the background and issues involved in cost variance 
investigation decisions, Chapter Two describes the detail of 
the two methods to be studied. Chapter Three presents the 
details of the simulation model, Chpater Four describes the 
results of the computer simulation for various cases, and 
finally, Chapter Five shows the conclusion derived from the 


analysis of Chapter Four data. 
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II. DESCRIPTION OF COST VARIANCE INVESTIGATION METHODS 


A. MARKOVIAN CONTROL METHOD [2] 

ioeec. fication 

The process operates in one of two possible conditions, 

1 = 1,2, of which condition 1 means that the process is in- 
control and condition 2 means that the proces is out-of-con- 
trol. If in control, the process may deteriorate into the 
out-of-control condition in the next period with a constant 
probability (l-g). But, once out-of-control, the process 
continues to operate in that condition unless investigated 
and corrected. This is summarized in the following Markovian 


process "Transition Matrix": 


1 Z 
i g (l-g) 
(Pa) 
Z 0 iL 


The functioning of the process generates, in each 
merlod, say j, a cost Se which is a random variable, with 
meseorobabpi lity distribution function Fi (t), depending upon 


the operating condition, i, of the process. 


prix. < x{i} = F, (x) i = 1,2 
(2-2) 


ERC 5 


on, 





The transition takes place befOre a cost is gener- 
ated, so that cost reports provide information about the 
Current status of the process. 

On receiving a cost report, the manager faces a 
choice. A first alternative is to regard the process as 
having gone out-of-control, and so to incur a fixed discre- 
tionary investigation cost, I, which will reveal what, if 
anything, is wrong with the process. It is assumed that if 
the process is found to be out-of-control, it is reset to the 
in-control condition with a constant correction cost K, but 
if the process is found to be in-control, it is left to 
operate as is. 

In the latter case, the manager is said to have com- 
mitted an type I error (incurring a cost when it was not 
necessary). 

The second alternative for the manager is to regard 
the process as being in-control, allowing it to run without 
intervention for one more period. In this case, the manager 
takes the risk of committing a type II error, that is, not 


investigating and correcting the process when, in fact, it 


was out-of-control. 


PcoUcEOmrolLeGy: Avotngle Critical Lime for the 


Cost Variance 

Consider the class of control policies in which the 
manager bases His decision between “investigate” and "don't 
investigate" on whether the actual cost X exceeds some 


constant value x. Then the conditional probabilities of 
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committing type I and type II errors are constant and are, 


respectively, as follows: 


Pr{Investigate|in-control} Pea co} 


shat dope sl Sal (ea) 


= Fy (x) 
PriDon't investigate|out-of-control} = Pr{X <x|i=2} 
BP, (x) (2-4) 


However, the unconditional probabilities of type I 
and type II errors do change with time, for they depend upon 
the probabilities of the process being in-control and out- 
of-control, which in turn, depend upon the number of periods 
elapsed since the last managerial intervention. 

If the process is in-control when the report is pro- 
duced, then, no matter what action the manager chooses, the 
process will start the next period in the in-control condi- 
tion with probability 1. If, on the other hand, the process 
is out of control when the cost report is produced, then it 
will start the period in the out-of-control condition with 
probability equal to the probability of a type II error, 

Fo (x), which is constant. Thus, the effect of manager's 
control action can be described by the following Markovian 


"Control Matrix": 


2 





il 2 <—condition of the 
process after 
di 1 0 "control" is 
exercised (2-5) 
2 1-F, (x) 1-F.. (x) 


condition of the process when the cost 
report is produced 


Therefore, we may define a new Markov process which 
combines the process Transition Matrix (2-1) and Control 
Matrix (2-5). We refer to it as the associated "Controlled 


(Markov) Process". 


g =G)) Th 0 
0 1 oa (x) F. (x) 
Transition Matrix Control Matrix 
i-(1-g)Fj(x) (1-9) F, (x) 
ee Zay) 


Controlled Process Transition Matrix 


The steady-state probabilities m, (x) (iS 45, 2) Sor 


the controlled Markov Process (2-6) are given by: 


1, (x) = (1-g) 1, (x) F, (x) te To (X) Fo (x) (Za) 
7, (x) + T (X) = 1 

| 2 =©.. (x) (1-g)F. (x) a 
nay I-gF,mm) ' "2 5) 1=GF5 (x) 
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AS may be seen from Figure 2-l, m4 (x) and To (x) are 
the steady state probabilities for the states in which the 
process finds itself at the end of the managerial control 
(or, equivalently, at the start of a period of operation). 
They are not the same as the steady-state probabilities S; (x) 
(a= 1,2) of the states generating the cost reports. Proba- 
Brlities S, (x) and So (x) are easily found by applying the 
process transition matrix (2-1) the the steady state vector 


T(x) ’ Ne ex 


S, (x) = Qj (%) 
(2-9) 
S, (x) = (ec) 1 **) e 9 (x) 
es 
1 -gF, (x) 
O—_——__—___— 0 -—-—— OO 
Controlled Process > Controlled 
state state state 
Process Control 
transition transition 


Figure 2-1: A Controlled (Markov) Process 


Seeelnceexpected Cost of Operating Controlled Process 


The total expected cost per period is the sum of the 
expected cost per period of (1) operating, (i1) investigating, 


and (iii) correcting the process. 


Zr 





- _ on 


-_ SS 





From Equations (2-2) and (2-9), the expected cost per 


period of operating the process equals: 


C, (x) = HS, (x) oF U5S5 (x) 


uigT, (x) = uy (1-g) 7, (x) a eg a 


Wo 7 7, (x) g4u 


where 


The investigation costs are incurred in the event 
that the cost report X > x. In the steady state, the uncon- 
ditional probability of the event X > x is readily computed 


uSing Equations (2-3), (2-4), and (2-9). 


Pr{X >x} 


Pr{X >x|i=1}s, (x) + Prix >x|i =2}s, (x) 


(l-g) 1 -F, (x) 
1 - OF, (x) 


1 -F, (x) Smet 


a 


m, (x) {1 = gF, (x) } (2-11) 


Hence, the expected cost per period for investigating 


the process equals: 
= = 2-12 
C, (x) m, (x) {1 QF, (x) }I ( ) 


Finally, the correcting costs are incurred in the 


event that the cost report X > x and the process is out of 


Zig 





control. In the steady state, the probability of such an 
event is simply the second term in Equacion (2-11) "ser7ehat 
the expected cost per period of correcting the process equals: 


eo jal -F, (x) ]K 


a = TS eyay gE (2-13) 


Thus the total expected cost per period of operating 
the controlled process is the sum of (20, (222) sand) (2=13), 


which can be expressed as follows: 


Ctx )eo = C, (x) + Cy (x) + Cy (x) 


= uy + my (x) { (L-g) (K+I-gau) - gI{P, (x)} 


uy + m, (x) fa - DF, (x) }, (Zea? 


where 


=a ot = aa 0 


a = : 
(2-15) 
b = gI (I = 0 is uninteresting). 
4. Optimal Policy 
A natural question at this point is: "what control 


limit x* is optimal?" Of course, the x that minimizes the 
total expected operating cost (C(x)) is the optimal control 
limit. To get the optimal value of x, the first order deriva- 
tive can be derived from Equation (2-14): 


dn. (xX) 
GO) 1 a mat ~ 
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dn, (x) ~(L=g) £, (x) 





(2-17) 
(1-gF, (x) }4 
The cost C(x*) is an extremum x* such that Grea 77 Asx 
=o That is: 


A279) £5 (x) ta-bF, (x*) }+bf, (x*) (1-F, (x*)} 1-gF (x*)}= 0 (2-18) 


2 


There are two possibilities: either x* is such that 


{a-bF, (x*) } = 0 and {1-F. (x*) } = 0; in this case m (x*) =e 


that is, the process runs uncontrolled forever. Or, since 
all other terms in Equation (2-18) are positive, x* must lie 


in the open interval on which; 


Paes) ) < .O,e that is,;) F. (x*) s> 


1 (2-19) 


oO | m 


1 


Intuitively we can understand that the optimal control 
limit should be a certain point where x* > Hye And for the 
peotian that x < x*, then C(x) > C(x*), also for the x such 
that x > x*, then C(x) > C(x*). Therefore we can get optimal 


Sentero ty limzt x* by trial and error. 


B. BAYESIAN CONTROL METHOD [3] 

In the Markovian control, the past cost reports don't have 
any effect on the current period's cost investigation decision. 
But in the Bayesian control it affects the current period's 
decision. 

Pee enaracteristic 

This method was first suggested by Bierman, Fouraker 


and Jaedike [1]. The methodology was first developed by 
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Duvall [6] and later was expanded by Dykman [3]. This method 
is based on the Bayesian decision theory. The subjective 
prior probability can be converted to the posterior proba- 
bility by additional information of periodic cost Lepore, 
according to the Bayes' Theorem. 


A two state, two action problem is assumed. 


84: in=-control 
85: out-of-control 
Ll? investigate 


do not investigate 


The decision on whether or not to investigate is 
based on reports of incurred costs. It is assumed that in- 
curred costs are reported on a periodic basis. Thus, a do- 
not-investigate action implies that the activity is continued 
at least until the next cost observation is available. An 
additional assumption at this point is that a full investiga- 
tion will always reveal the cause of an out-of-control action, 
which can then be immediately corrected. 

The cost of investigation 1S assumed to be some con- 
stant I, and the present value of the savings obtainable from 
an investigation when the activity is out of control is L 
(L = Actual savings from the process-——-correction cost K) where 
L > I; otherwise an investigation would never be warranted. 
Values of L must be estimated before this method can be made 
operational. 

Once L and I have been estimated, the payoffs in costs 


for the investigation problem in two-state form are as given 
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in Table 2-1. Typically these values will be of a magnitude 


such that the decision maker is willingto act on the basis 


of the expected values. 


Table 2-1 


General Payoff Matrix 


64: in-control 86.2: out-of-control 


wee aon’ t 
investigate 








NO 
Hi 
1 
ie 


To start, the process is assumed to be in a state of 


control but may move out-of-control with probability (l-g). 
The process cannot shift from the out-of-control state to the 
in-control state. As in the Markovian control method, this 
Situation can be represented by a Markov process with transi- 


tion matrix: 


il 2 
1 g ay 

(2-20) 
2 0 il 


2 Control BolLey: Sage Critical PEopabi lity for 
the Posterior Probability of the In-Control State 


Assume now that the decision maker can and 


does have a (prior) subjective probability mass 
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mmetron, Call it foe Over the states. Let the probability 
of state Hs in any period n (n = 1,2,...) be denoted by £84). 
Thus the initial probabilities are given by I (oe )2 
J 
Under these assumptions, the "investigate" action 


Should be taken at some stage n if its expected cost is less 


than the expected cost of delaying investigation. That is: 
E[C(a,,8)] < E[C(a,,6)] = 0 


where C is the payoff random variable and 6 is the state 


random variable. Substituting this means that 
Clft (64) ] + [I-L] [1-f£, (6,)] no (2-21) 


An investigation is immediately called for if c{f, (8,)] 
~ [I-L] [1-£, (6,)] is negative. In each future period n 
‘ime 1,2,.-..) a cost level “i is observed. Suppose that this 
cost level is more likely to occur when the process is out of 
control (see Figure 2-2). This increases the probability of 


state 6, at the expense of state 81° Ff the probability attach- 


Z 


ing to the 6. is increased enough, then the expected loss from 


2 
investigation will be less than the expected loss from not 
investigating and action ay is preferred. 

By the characteristics of the transition from in-control 
to out-of-control, the state probabilities should be adjusted. 


It can first be adjusted to reflect the effect of the transi- 


tional probabilities (2-20). 
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in-control out-of-control 


£,(x| 6.) 


f 


E(Xx|6,) x E(x|6,) 


Pecune 2-2: iCost Distributions 


Assuming that if transition occurs before a cost 


observation, the results are: 


£684) = gf 71 (94) 
(2-22) 


2 Sao) en ame et Oe 


These are illustrated in Figure 2-3. 


Then using these adjusted probabilities as prior 
probabilities of the period n, the revised probabilities 


given a cost report x can be obtained by Bayes' Theorem. 


f (x]6.)£' (02) 
= Ls (2-23) 


£665) = £, (85 |x) 
£,(x]6,) £2 (6,) 


ll Ia NOL 


j=l 


Note that state 64 Cannot Occur in) perlod nm If gis 


did not exist in period n-1l and out of control state is 


assumed to be discovered if an investigation is made. 
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state in period probability state in pericd revised state 
n-1 and state of state n and state probability 
probability change probability 


£,,(x| 9) £ (91) =£,, (8, |X) 
ae 


= £) (8) 








ile s < 
£ 4-1 (95) (1g) £,_) (6) 
+ fn (95) = £85) 


Figure 2-3: Illustration of Bayes' Theorem 
for Revised Probability 


In order to avoid the expected value calculations each 
time a cost value is observed, the breakeven probability that 
equates the two actions can be obtained. To do so, let the 
revised state probability for state 84 after n cost observa- 
tions be given by £691) - Thus Ff 85) =1l1- F684): Then 


solving for the expected costs of investigation gives: 
E[C(a,6)] = cf (5)) + [{I-L) [1 ~£,(6))1 (2-24) 


If this expectation is less than zero, the process 


is a candidate for investigation; while it exceeds zero, the 
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process is not. Setting the expectation given by Equation 
(2-24) equal to zero and solving the equation gives the 


breakeven value, or the indifferent PO lm 


f,(e,) = S54 (2-25) 
For example, we assume that L equals 12,000 anda 
equals 2,000, then the breakeven probability is 0.83 
( (12000-2000) /12000). This breakeven probability is denoted 
by gq in this paper. If £684) <q, an investigation is sig- 
naled, otherwise it is not. Note that the breakeven value 
is independent of stage n and therefore relevant to all time 


periods. 


C. DISTINCTION BETWEEN TWO METHODS 

The major distinction between the two methods are the 
criteria of whether or not to investigate the process. The 
Markovian Control method relies on the critical limit (x*) 
to decide whether or not to investigate the process. The 
process is investigated simply because the reported cost ex- 
ceeds a critical value x*; the history of cost reports is for- 
gotten. The critical limit can be obtained by trial and 
error. On the other hand, the Bayesian Control method relies 
on the critical probability (q) to decide whether or not to 
investigate the process. In this method, the manager keeps 
track of the probability of the process being in-control at 
the time of the next cost report; the periodic cost reports 


serve to update this probability and the process is investigated 
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whenever the updated probability is less than the critical 
Becbability. 

Although each method has a different criterion for the 
investigation of the process, both methods aimed to minimize 
long run expected cost. Thus we have to resort to the long 
run expected cost in comparing the effectiveness of the two 
methods. An analytical approach to the comparison of effec- 
tiveness of the two methods was presented in the article "Cost 
Variance Investigation: Markovian Control versus Optimal Con- 
trol" [7], by Dittman and Prakash in 1979. In this article 
they concluded that "it is observed that Markovian Control 
(Dittman-Prakash policy) performs almost as well as the Opti- 
mal Control (the best Bayesian policy) unless the in-control 
cost has substantially greater dispersion than the out of 
control" [7: p. 358]. The best Bayesian policy means that the 
process is controlled by optimal critical probability (q*), 
which can be obtained from solving dynamic programming sug- 
gested by Kaplan, rather than controlled by the breakeven 
probability (q) (which is simpler than optimal critical 
probability). Dittman and Prakash assumed that the Optimal 
Control was the best control method under the criterion of 
minimizing long run expected cost. But Markovian Control is 
less complex than Optimal Control to apply. Under these 
assumptions they measured the opportunity cost of simplicity 
in the Markovian Control. 

This analytical approach did not do anything with the 


actual periodic cost report. How the actual cost reports 
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behave against the theoretical control criteria can be 
examined only by an empirical study (simulation). Cost re- 
port in a period is a random sample from the defined proba- 
bility distribution and the manager should decide whether or 
not to investigate the process by this random sample. 

In this paper Bayesian Control with the breakeven proba- 
bility is compared with the Markovian Control. The two methods 
are selected for comparison for the following two reasons: 

(1) both are easy to apply in a realistic setting and there- 
fore the opportunity cost of simplicity can be glossed over; 

(2) for research has not been done to compare the relative 
effectiveness of the Markovian Control and the breakeven criti- 


cal probability Bayesian method. 
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IIIf. DESCRIPTION OF THE SIMULATION MODEL 


A. DECISION-MAKING ENVIRONMENT 

The preceeding chapter described the Bayesian and the 
Markovian decision models. However the relative effective- 
ness of the two models remains to be tested. Different 
decision-making environments, such as cost savings from an 
investigation, different distributions of cost performance 
under the in-control or out-of-control state, etc., may have 
different effect on the usefulness of the two decision models. 

In the Markovian Control model the process cost was ex- 


pressed by Equation (2-14): 


eye = ou, + m, (x) fa bP, (x) 3, 
where 

a = (l-g)K + I - gAu, 
and 

b = gl. 


If the process is never investigated, the long run ex- 
pected process cost per period 1s Uo (the mean cost of out- 
of-control state). Therefore in the above equation, the term 
mT, (x) fa ~ bP, (x) } = s(x) should be negative for control to be 
worthwhile. Since Fy (x) can never be greater than one and 


m4 (x) can never be negative, if the value a/b is such that 


os 


yy 6S > 








a/b > 1.0, the term s(x) is necessarily positive. It means 
that the optimal policy for this process is "never investi- 
gate". On the other hand, if the value of a/b is much smaller 
miami l.0, the OOtimal policy is “always investigate". Thus, 
the relevant range for the value of a/b should be less than 
one but not too much less than -1.0. 

In the Bayesian Control model, the control point (or 
breakeven probability) was expressed by Equation (2-23) (=—). 
In the same context, the extreme values of breakeven proba- 
bility (close to zero or close to one) are not proper for 
comparison with the Markovian Control model. 
meee ROBABILITY DISTRIBUTIONS OF IN-CONTROL AND OUT=-OF= 

CONTROL STATES 

In order to evaluate the relative effectiveness of the 
two models under study, we can consider various combinations 
Seamorobability distributions of in-control and out-of-control 
states. For example, dispersion of in-control state can be 
larger or smaller than or the same as that of the out-of- 
control state. 

The probability distributions assumed in this simulation 
study are as follows. 

(a) Equally dispersed in-control and out-of-control states 
with low degree of overlap--in this case, the mean cost of an 
in-control state is assumed to be $100 with a standard devia- 
tion of $5, and the mean cost of an out-of-control state is 
assumed to be $120 with a standard deviation of $5. 


Figure 3-1 depicts this situation. 
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out-of-control state 
N(120, 5) 


in-control state 
N(100,5) a 






\ 





85 100 120 P33 


Figure 3-l: Equally Dispersed Low Overlap 


(b). In-control state less dispersed than out-of-control 
state--in this case, the mean cost of an in-control state is 
assumed to be $100 with a standard deviation of $5 and the 
mean cost of an out-of-control state is assumed to be $120 
with a standard deviation of $30. 


Figure 3-2 depicts this situation. 


in-control state out-of-control state 
N(100, 5) N(120,30) 
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Figure 3-2: In-Control Less Dispersed 
Than Out-of-Control 


(c). In-control state more dispersed than out-of-control 
state--in this case, the mean cost of an in-control state is 


assumed to be $100 with a standard deviation of $30 and the 
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mean cost of an out-of-control state is assumed to be S20 


with a standard deviation of $5. 


Figure 3-3 depicts this situation. 


out-of-control state 
in-control state poe N(120, 5) 
N(100, 30) 





10 100 ©6120 190 


Figure 3-3: In-Control More Dispersed 
Tian OuL-oL-Conurel 


(d). Equally dispersed in-control and out-of-control states 
with large degree of overlap--in this case, the mean cost of 
an in-control state is assumed to be $100 with a standard 
deviation of $30 and the mean cost of an out-of-control state 
is assumed to be $120 with a standard deviation of $30. 


Figure 3-4 depicts this situation. 


. out-of-control state 
N(100, 30) ; 


a = 
I LY Oe 


10 100 8120 20 


Figure 3-4: Equally Dispersed Large Overlap 





For the following two cases, the probability distribution 
of the out-of-control state is assumed to have a gamma dis- 
tribution. The gamma distribution is not Symmetric, it is 
skewed to the left from the mean (Figure 3-5). The gamma 
distribution is decided by two parameters (y,A). Since the 
parameter y affects the shape of the distribution, we can 
make various shapes by selecting proper y according to the 
characteristic of the cost process under consideration. For 
some Situations, the use of gamma distributions could be more 


practical and more similar to the actual process. 





rA=1 


Figure 3-5: Gamma (y,1) Distributions 


(e). Normal distribution with small dispersion in in-control 
state and gamma distribution in out-of-control state--in this 
case the in-control state is assumed to be a normal distribu- 
tion with a mean of $120 and X} equal to one. Since parameter 
y affects the shape of the gamma distribution, the shape is 
approximately symmetric when y exceeds 50. To simulate a 
process skewed to the left, two is assumed for the parameter 
y and then it is transformed to the mean of 120. The formula 


chosen for the transformation is Y = 85 + 17.5X; where X is a 
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Gamma (2,1). Then the mean of Y is 120 and the variance of 
Y is 612.5 (standard deviation is 24.75). We can make differ- 
ent shapes of Gamma (2,1) with various mean and variance by 
adding and multiplying Gamma (2,1). For convenience, G(120,1) 
refers to the transformed distribution in this paper. 

Figure 3-6 depicts this situation. 


in-control state 
N(100, 5) 







out-of-control state 
G(120,1) = G(2,1) x17.5 + 85 


85 100 120 170 


Figure 3-6: Narrow Normal In-Control and 
Gamma Out-of-Control 


(£). Normal distribution with large dispersion in the in- 
control state and gamma distribution in the out-of-control 
state--in this case the in-control state is assumed to be a 
normal distribution with a mean of $100 and a standard devia- 
tion of $30 and the out-of-control state is assumed to be the 
same as case 5. 


Figure 3-7 depicts this situation. 


out-of-control state 
in-control state G(120,1) = G(2,1) x 17.5 + 85 


N (100, 30) 






10 100 120 190 


Figure 3-7: Wide Normal In-Control and 
Gamma Out-of-Control 
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C. BOUNDARY CONDITIONS BETWEEN OUT-OF-CONTROL STATE AND 
IN-CONTROL STATE 


We can further consider different boundary conditions in 
which the status of a cost process at the beginning of each 
period is assumed. Both the Bayesian Control model and the 
Markovian Control model assume that an investigation always 
uncovers the reason why the process has deteriorated to the 
out-of-control state and that the causal factor is corrected. 
However, we can suppose a boundary condition between out-of- 
control and in-control state. If we investigate the process 
when the process is in control, we may or may not know to 
what degree the process has transferred into the out-of- 
control state. If an investigation simply reveals whether the 
process is in-control or out-of-control but does not deter- 
Mine to what extent the process is drifting toward out-of- 
control state, the probability of the in-control state doesn't 
return to one at the beginning of the next period by an inves- 
tigation in the preceeding period. In other words, the pro- 
cess will operate one more period in the same condition as 
at the end of the preceeding period, i.e., it is drifting into 
out-of-control state to some extent. Thus the probability 
of the in-control state at the beginning of the next period 
May not return to one; say condition (2). 

On the other hand, we can also suppose that the above 
boundary condition cannot exist and that an investigation al- 
ways reveals the status of the cost process and the probability 
of the in-control state is returned to one after an investiga- 


tion; say condition (1). 
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D. SAVINGS FROM AN INVESTIGATION 

Since L, the loss for failing to conduct an investigation 
or savings from a productive investigation, is specifically 
considered in the Bayesian Control model but not in the 
Markovian Control model, this study also examines the effect 
of varying the value of L on the effectivenes of each model. 

The three values selected for this study (25, 45, 100) are 
admittedly arbitrary, but the purpose is to identify the 
direction of the change in effectiveness, not the "correct" 
and "efficient" absolute number of each model, which really 
does not exist except by subjective estimation. When consis- 
tent patterns in model effectiveness are discovered, additional 


values of L are simulated to ascertain the pattern. 


E. SUMMARY OF CONDITIONS SIMULATED 

Under each of the two boundary conditions there are 18 
different combinations of cases (data points) according to 
the assumptions made on different cost distributions and sav- 
ings. The 18 data points are summarized in Table 3-1. 

The values for the investigation cost (I), correction 
cost (K), transition probability (g) and mean differential 
cost (Au) are assumed to be 15, 5, 0.9 and 20 respectively in 
all cases. Calculated value of a and b are -2.5 and 13.5, 
respectively. Therefore the value of a/b (-0.185) is not an 


extreme case. 


F. SIMULATION PROCEDURE 
The simulation procedure is summarized in Appendix A in 


the form of computer program flow chart. The computer program 
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Table 3-1 


18 Different Data Points Considered 


is, K= 5, g = 0.9 


7 N@oorS) N (100,30) 



















































































































N(100,5) N(100,5) N(100,5) N(100,30) | N(100,30) | N(100, 30); 
N(120,5) N(120,5) N(120,5) N(120,5) N(120,5) N(120,5) | N(120,5) 

L = 25 AS L = 100 L = 25 eae L =100 

N(100,5) N(100,5) N(100,5) N(100,30) | N(100,30) | N(100,30) 
N(120,30) | N(120,30) | N(120,30) |} N(120, 30) N(120,30) | N(120,30) | N(L20, 30) 

L = 25 L = 45 L=100 L = 25 L = 45 L=100 

N(100,5) N(100, 5) N(100, 5) N(100,30) | N(100,30) | N(100, 30) 
e120) 1) edizoe)) G(120,1) G(120,1) Ctopay) CG Gi2emaeG (20,1) 

L = 25 L = 45 L=100 L = 25 L = 45 L=100 

N: Normal distribution G: Gamma distribution 


G(120,1): Refers to G(2,1)x17.5 + 85 


1s included in Appendix B. One hundred periods are simulated 
in each sample and 50 samples are used to estimate the mean 
differential cost (X,) between the two decision models. Al- 
ternatively, one can interpret that the simulation result is 
based on 5000 iterations, which is more than enough to guaran- 
tee stability of the simulation result and provide the basis 
for the evaluation of the long-term effectiveness of the deci- 


sion models under study. 
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IV. DISCUSSION OF RESULTS 


Results of the implementation of the simulation model 
for the data points and conditions, that were explained in 
Chapter III, are summarized in Table 4-1. 

In Table 4-1, the positive value of Xy means that the 
incurred cost for Bayesian Control is less than that of 
Markovian Control and the negative means the converse. To 
test whether or not the values are statistically significant, 
Table 4-2 shows the 95% confidence interval for each value 


ae Xp: We can say that the value of Me 1s statistically signi- 
ficant if the confidence interval doesn't include zero. Other- 
wise, we can't say that. Furthermore, we have to compare the 
value of Xo with the mean difference cost between in-control 
and out-of-control state ($20 in this study). This comparison 
enables us to see the relative magnitude of the value of Kass 
We now can look for significant patterns in the tabulated 
results. A relative magnitude of differential cost between 
the two control methods can be used to figure out whether or 
mocemtne differential cost is practically significant. The 
differential costs of the two control methods are affected 
by the mean cost difference of the two states (Au) to some 


extent, but not affected by the absolute amount of a cost 


report. 
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Table 4-] 
Simulation Results 


(a) N(100,5) N(120,5) 


Condition (1) Condition (2) 


Data Savings M P = Reve o = c 
Points —(L) : ok ee ‘Taj 
1 25 112.50 0.40 0.176 0.9 0.262 Oc 75 10500 6260 
Zz 45 m2. 50 0.67 0-210 — 11) 0.256 OFZ09 12 Ose. / 
3 100 2, DOM S5 «6OL1eS) 60.9 80.284 07178) O29) 205284 
(b) N(100,5) N(120, 30) 
25 112.65 0.40 0.996 5.0 0.708 O-63] S452 0. 762 
45 iN 2. 65e0.07 =0.249% 0120.94 1020505. lees) 
100 HZ 30o 0 eo) 5.0 lo 1956 le O20 8-4 O11 24 6 mee eee 
i ee(t00,30) N(120,5) 
25 29 eNO 40). Ved 02 9e29s 5 pelecO4d 2,029 10.1) (ease? 
45 diy 32a 0.01 2,057 610.2 sia 216810, See wires 
100 U7 25 0 35. 224818 24 e023 2.015 Loci Sees 
(a) N(100,30) N(120, 30) 
10 25 13029550240" - 0.580. 2.97 21.043 1.300 7:6.5 fies 
ae 45 1307958050) 4 S90 Rr eS. 0) med 1.9649 926 Wie3so 
eZ 100 13029570285. 0.2837 124-7 1094. -0-023" 0. Mire c6 
(e) N(100,5) G(120,1) 
ES 25 3570.40 (0.566. 2.380.784 0.434 2.2 0.842 
14 45 10685 0.67 =0.045 -.7322. O7e22.  -=1.205. 62> Beg 
LS 100 912..35 0.85 —4.266 21-234 0-938. =4.754 23-3 ee le2Zo0 
(£) N(100,30) G(120,1) 
16 25 24550) 0740 122979. 5 6. Seog 22313 16 Blaze? 
i] 45 924.50 90.67 225502512755 0-930 82426. 1) (ae eee 
Ts 100 Ae SOO. Co 2osl ep Ome ZO 2.191 14.0° t1s305 
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Ss : 


Tapes (Cont. d) 


Estimate of X13 Arithmetic mean of incurred cost of 
Markovian Control minus incurred cost of Bayesian 
Control, derived from fifty mean (Xp) of one hundred 


iterations. 





(3): Relative magnitude of x, to the mean difference 
cost between in-control and out-of-control state. 
X Re 
ir = x 100 ae xp * 100) 
2a Sz 
D 


Estimated standard deviation of Xx. (S= = —) 
DD V49 
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Table 4-2 


95% Confidence Interval of x 


D 
Data 
Points Conditions (1) Condition (2) 
1 OS OL =. s0'e2 5 i 0.101 - 0.249 
2 Veo) a Oress 0. L3Gee = Se 0eco7 
5 0.104 - 0.266 0.097 = 0.259 
4 OF Oe 1S 0.614 - 1.048 
5 SUieo2o = OsOsl* -1.363 - -0.692 
6 “4.218 - =-3.611 -5.243 =- -4.578 
a 1.544 = 2.260 1.647 - 2.411 
8 l698 s— ~ 2.376 1.809" -= 22529 
9 Zoli? S= 2.085 Sc eOoNe= 2294) 
10 Orezes = "0.877 0.980 - T7620 
ik 1.274 = 1.906 1.641 = 2.287 
dz -0.028 - 0.594% O37 = Ose 
slags Cis!) = Oey 0.194 - 0.674 
14 “0.879 -~ ~0.411 -1. 580 ~- =1,026 
15 “4.533 = ~3.999 -5.104 - -4.404 
16 2956 “= 1.6386 1.990 “= 2.676 
7 2229 pire eS 3.109 - 3.743 
eS oa = 2s Ole 2.420 - 3.108 


t value (95%, 49 degrees of freedom): 2.012 


* data cell that is statistically indifferent 
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A. EQUALLY DISPERSED IN-CONTROL AND OUT-OF-CONTROL STATE 
WITH LOW DEGREE OF OVERLAP (N(100,5) ,N(120,5)) 


This case included data points 1,2,3. Bayesian Control 
Bereormed better than Markovian Control in all the data 
points of this case. But the relative magnitudes of differ- 
ential cost of the two methods were small. The greatest 
magnitude in Table 4-l1(a) was 1.1 percent of the mean differ- 
ence cost between the two states. Therefore, it is hard to 
conclude that the one method performs better than another. 

Dispersion of the distribution of states can be interpreted 
as a degree of uncertainty in a probability distribution. The 
degree of uncertainty in this case is relatively small for 
both states. It means that the chance of a manager committed 
to type I, or type II error is very low. Therefore small 
Magnitude of differential cost of the two methods can be 
attributed to that reason. 

B. IN-CONTROL STATE LESS DISPERSED THAN OUT-OF-CONTROL STATE 

ORE) Niel 20, 30) ) 

This case included data points 4,5,6. This case is more 
likely to occur in the real world. It is reasonable that the 
outcome is an in-control state is more certain than that of 
an out-of-control state. 

In this case, Markovian Control performed better than 
Bayesian Control for larger values of L, but the reverse is 
true for lower values of L. In the medium range, however, 
the result is inconclusive, as indicated by the *. The rela- 
tive performance of the Markovian Control compared to the 


Bayesian Control was bettered as the amount of savings 
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increases. To see the trend of the differential cost be- 
tween the two methods, differential costs for three addi- 


tional values of savings were obtained. Figure 4-1 shows 


this result. 
x, + 
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Figure 4-1: Relationship Between X 


D and L(B) 


The relative magnitude of Markovian Controls’ better per- 
formance was relatively large in the larger values of L; it 
was 19.6% under condition (1) and 24.6% under condition (2). 
On the other hand, the relative magnitude of Bayesian Control's 
better performance in the lower values of L was around 5%. 

Therefore, we can say that the Markovian Control performs 
better than Bayesian Control in this case, especially when 
the value of L is large. 

C. IN-CONTROL STATE MORE DISPERSED THAN OUT-OF-CONTROL STATE 

Ono 20), N(120, 5) ) 

This case included data points 7,8,9. This case is less 
likely to occur in the real world. 

In this case, the Bayesian Control performed better than 


the Markovian Control in all the data points. And the relative 


47 





performance of the Bayesian Control compared to the Markovian 
Control was bettered as the amount of Savings increases. 
This trend is the reverse of Case B discussed above. Figure 


4-2 shows the relationship between x, and L. 


+4 
x 2.04 2.26 2 44 
1.97 : . 
a +2 i 90 0 
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Figure 4-2: Relationship Between Xp ana ibe) 


3 


The relative magnitudes of Bayesian Control's better 
performance ranged from 9.5% to 13.1%. 

Therefore, we can say that the Bayesian Control performs 
better than the Markovian Control in this case. 

D. EQUALLY DISPERSED IN-CONTROL AND OUT-OF-CONTROL STATE 

WITH LARGE DEGREE OF OVERLAP (N(100,30) ,N(120,30)) 

This case included data points 10,11,12. In this case, 
the Bayesian Control performed better than the Markovian 
Control in the middle range of L values simulated. However 
the advantage of the Bayesian Control model appears to de- 
crease as the assumed value of L gets higher or lower. 
Figure 4-3 shows the relationship between Xp and L. 


The relative magnitude of Bayesian Control's better per- 


formance was greatest in the medium values of L; it was 8% 
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Figure 4-3: Relationship Between Xp and L(D) 

and 9.8% respectively under the two boundary conditions 

assumed. Therefore, the results of this case is somewhat 

inconclusive. 

E. NORMAL DISTRIBUTION WITH SMALL DISPERSION IN-CONTROL 
STATE AND GAMMA DISTRIBUTION IN OUT-OF-CONTROL STATE 
OnNelnoie, 5) ,G(120,1)) 

This case included data points 13,14,15. In this case, 
the Bayesian Control performed better than the Markovian 
Control in the lower values of L and the Markovian Control 
performed better than the Bayesian Control in the medium 
and larger values of L. Figure 4-4 shows the relationship 
between ae and L. 

The relative performance of the Markovian Control compared 
to the Bayesian Control was bettered as the values of L 
increases. 

The relative magnitudes of Bayesian Control's better per- 
formance were 2% in the lower values of L and those of Markovian 


Control's better performance were around 5% in the medium values 


of L and around 22% in the larger values of L. 
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Figure 4-4: Relationship Between re a rice) 

Therefore we can say that the Markovian Control generally 
performed better than the Bayesian Control in this case. 

F. NORMAL DISTRIBUTION WITH LARGE DISPERSION IN-CONTROL 
STATE AND GAMMA DISTRIBUTION IN OUT-OF-CONTROL STATE 
ceno0> 3G) ,G(120,1) ) 

This case included data points 16,17,18. In this case, 
the Bayesian Control performed better than the Markovian 
control in all the data points. The relative performance 
of the Bayesian Control compared to the Markovian Control 
was best in the medium values of L. Figure 4-5 shows the 
relationship between x, and L. 

The relative magnitudes of Bayesian Control's better per- 
formance were around 9% in the lower values of L, around 15% 
in the medium values of L and around 12% in the larger values 


Of i... 
50 








Zon 35 45 65 85 


100 (L) 


Figure 4-5: Relationship Between Xp and L(F) 
We can say that the Bayesian Control performed better 


mean the Markovian Control in this case. 


Gueecool REPORTS OF THE PROCESS 

As a by-product of the simulation, a mean of cost reports 
derived from the 5000 iterations was calculated for each case. 
Cost reports depend on the combination of cost distribution 


of the two states. Table 4-3 shows those results. 


Table 4-3 


Means of Cost Reports 


ee ee 1 ee Markovian Control Bayesian Control 
State State Condition (1) Condition (2) Condition (1) Condition (2) 

a N(100,5) N(120,5) ODS NODS 102.07 LOZ aus 
b N(100,5) N(120,30) 105.93 LOS 77 103.64 105.38 
¢ N(100,30) N(120,5) 104.22 105.98 102233 102.34 
d N(100,30) N(12030) 105.31 VOT ae? 104.07 105.04 
e N(100,5) G(120,1) 106.09 106.20 103.98 TO. 9s 
foe nitroo,30) G(120,1) 105.85 1072 103741 IGSs6> 


Bale 





In Table 4-3, we can see that means of cost reports are 
slightly different from case to case. The mean of cost re- 
ports were not affected much by the distributions of the 
two states in the controlled process. 

Cost differences between the mean of Bayesian Control's 
cost reports and the mean of Markovian Control's cost reports 
do not affect the differential cost of the two methods a) 


in the simulation model of this paper. 
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V. CONCLUSION 


Suggestions to use statistical models to investigate cost 
variances originated from the statistical Guality comene 
techniques in industry. However, the application of statisti- 
cal cost variance investigation methods is minimal so far. 
Kochler reported that "in some general inquiry from some 
prominent corporations, I was unable to find single use of 
Statistical procedures for variance control" [13]. He attri- 
butes this paucity of applications not to the inherent in- 
applicability of such procedures but to "the fact that ac- 
countants have not recognized a conceptual distinction between 
a Significant and an insignificant variance" [13]. Therefore, 
he proceeds to advocate the use of simple testing procedures. 

The optimal cost investigation policy developed under the 
Dynamic Programming approach (Kaplan) [6] obviously is diffi- 
eet to apply. This study compares two statistical models 
that are relatively easy to apply. The purpose of this study 
is to examine the relative effectiveness of the Bayesian 
Control model and the Markovian Control model under different 
assumptions. 

The results of the simulation study shed some light on the 
relative effectiveness of two well developed models under 
various conditions. 

In Table 4-1 we can see that the values of X were not 


D 


much different between condition (1) and condition (2) for 
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each data point. It means that whether or not the probability 
of the in-control state returns to one after an investigation 
doesn't have much influence on the performance of the two 
models. In other words, different assumptions about the 
probability of the in-control state after an investigation 
are not an important issue. 

Based on the analysis of the simulation results, some 
general conclusions regarding the relative effectiveness of 
the two decision models can be made as follows: 

(1) When the distributions of the two states (in-control 
and out-of-control) are identical (Cases A and D), both deci- 
sion models are virtually equally effective, although the 
Bayesian model has a slight edge when the distributions are 
widely dispersed (Case D). 

(2) When the distributions of the two states are different, 
the effectiveness of a cost variance investigation decision 
model seems to be dependent on the cost distribution of the 
Me-cOntcrol state. 

ai Lf the cost distribution of the in-control state is 
normal with low degree of dispersion (Cases B and E), the 
Markovian Control model has a distinct advantage, especially 
when the value of L is high. This finding is generally con- 
sistent with Dittman and Prakash's conclusion [7]. 

b) If the cost distribution of the in-control state 
is normal but the dispersion is wider than that of out-of- 


control state (Cases C and F), the Bayesian Control model 
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seems to have an edge. One must admit, however, that Cases 
C and F are less likely to occur in the real world. 

(3) The assumed value of L plays a significant role in 
the relative effectiveness of a decision model in all but 
Case A. The larger the value of L is assumed, the better the 
relative performance of the Markovian model in Cases B and 
E (normal distribution with narrow dispersion for in-control 
state). Curvilinear relationships are found in Cases C and 
D (normal distribution with wide dispersion for in-control 
state). 

In summary we observed that the Markovian Control decision 
model seems to be as effective as, if not better than, the 
Bayesian Control model in those conditions more likely to be 
found in the real world. However the Bayesian Control model 
seems to be more effective in those special cases where the 


cost distribution of an in-control state is widely dispersed. 
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APPENDIX A 


PROCEDURES OF THE SIMULATION MODEL 


The procedures of the simulation model can be explained 
by a step-by-step discussion of the flow chart of it (Figure 
A-l). For the convenience of explanation a alphabetical label, 
under which each procedure is explained, is attached to each 
procedure. 

(a) For the simulation the variables that should be esti- 
mated outside of the model are given as external factors. 

L(long run expected savings from an investigation) is not 
an easy matter to determine. But it can be determined by the 
method that was suggested by Duvall {8]. 

I(cost of investigation), g(the probability that in- 
control state in the current period still remains in an in- 
control state, in the next period), and K(correction cost 
when the process is out-of-control state) can be estimated 
from the past experience and historical data of the process. 

Then the distributions of two states can also be deter- 
mined by past experience. 

For example, during the first iteration we assume that 
L equals 60, I equals 15, K equals 5, g equals 0.9, the dis- 
tribution of the in-control state is N(100,5) and the dis- 
tribution of the out-of-control state is N({120,5). This set 
of numbers will be used in the discussion of steps that 


follow tor illustration purposes. 
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(a) 


(b) 


(a) 






impaeeo, l,d,% and 
parameters of distri- 
bution of in-control 


(uy 094) and out-of- 
control (515) 





(c) 


Calculate the probability 
of state in-control (Puy P,) 






and out-of-control 


= q-P! = q-Pp! 
P= GP, Py = g-Py 





Generate a uniform random 


number R from U(0,1) 





(f) 


Figure A-l: Flow Chart 
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Calculate control limit 
(M z) for Markovian Control 


and breakeven probability 
(q) for Bayesian Control 





No 


Yes 





(g) Gy 


Generate.a random number 
from the distribution of 
in-control state (Ny) 




















cost of the process 
for the Markovian Control 


Cy = 0 


'=- 
PM Pu 


cost of the process 
for Markovian Control 


ae: 


Pa = (concer eieme( 1) 






pi = Pu (GondTtien (2) 


@) 


Generate a random number 
from the distribution of 
out-of-control (N,) 


> 


cost of the process 
for Markovian Control 


Gn = 2 7 HL 












cost of the process 
for the Markovian Control 


C= (uo —uy) - (I +K) 









Figure A-1 (Cont'd) 
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(i) ec 


Generate a random number 
fran the distribution of 
in-control stae (N,) 











calculate revised probability 
for in-control state by 
Bayes' Theorem (Ppp) 







Par iq No 















cost of the process 
for the Bayesian Control 


C, = 0 


cost of the process 
for the Bayesian Control 


c=1 


PS =] (Condition (1)) 


PS = Par (Condition (2) ) 


(3) So 


Generate a random number fram 
the distribution of out-of- 
control state (N,,) 













calculate revised probability 
for in-control state by 
Bayes' therorem (Pap) 











cost of the process for 
the Bayesian Control 


eae 


cost of the process for 
the Bayesian Control 


C, = (4-H) ~ CFR) 










Figure A-1 (Qont'd) 
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(b) Then we can assume that the process starts with in- 
control state; probability of in-control state equals one 
and the probability of out-of-control state equals zero. A 
cost report comes from the process which was transformed by 
the Transition Matrix from the prior period's states. There- 
fore we can calculate the probability of the in-control state 
of the process from which the cost report comes out. 


For example, for period one, 


PM 


1x0.9 


I 
© 
e 
\O 
=e 


a 


i 0.9 


I 
oO 
G 
oO 


(c) In this step, we calculate the optimal control limit 
(M.) for the Markovian Control by trial and error method. 
Total cost of the process decreases as the value of the con- 
trol limit increases until a certain point. Beyond this point, 
total cost of the process increases as the value of the con- 
trol limit increases. Therefore we can find a point which 
minimizes total process cost. It is a search process in the 
computer program (see Appendix B computer program). 

For example, the total cost of the process for a given 
control limit of Markovian Control is as follows: suppose 
Pmat a given Control limit is 110. 


From Equation 2-15; 


(l-g)K + I - gAy = (0.15) +15 - (0.9 x20) = -2.5;3 


fy 
Il 


b = gi = 0.915 = 13.5. 
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From Equation 2-8: 


ere) eee) 
7 oe ee 2 ae 
1 1 - oF, (x) elo baa 
F,(110) = Pr(X < 110(N(120,5)) 


We can obtain the value of F(110) from the normal proba- 
bility table. For computer simulation, we can obtain from 
the IBM IMSL library by using CALL MDNOR (Z,PROB); where Z is 
a value of the standardized normal distribution ((X-y»)/o = 
(110-120)/5 = -2) and PROB is a value we want to get 
(F, (110) ) [9]. 

From the standard normal distribution table; Pr(Z < -2) = 
0.0028 and by the same way F, (110) = Pr(x < 110|N(100,5)) = 


Wme772. Then, 


_ l1 - 0.0228 = 
m, (110) =) 17> oma aomO Dae 0.99767. 


From Equation 2-14, the total cost of the process 1S; 
C(110) = 120 + 0.99767{(-2.5) - 13.5(0.9772)} = 104.3. 


We can find the optimal control limit (M.) which minimizes 


the total process cost by repeating the above steps. 


For the Bayesian Control, the breakeven probability (q) 


can be obtained from Equation 2-25; 


E 
I 
IH 


6 OMe 


2 = a5. 
a = = Vey 
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(d) Now we generate uniform random number by the random 
number generator. In the IMSL library, GGUBS is available. 

In this paper, however, the random number generator at the 
Naval Postgraduate School is used because it is more efficient 
than GGUBS. 

The procedures are as follow: [10] 

CALL OVFLOW, 

CALL RANDOM (SEED,R,A), 
where SEED is a seed for the generation, R is a single array 
variable that represents random numbers and A is a number that 
represents how many random numbers we need. 

For the numerical example to be discussed later, the 
random number generated in this step is 0.86565. 

(e) In this step, the stochastic process of the state can 
be decided by using generated random numbers. If the generated 
random number is less than or equal to the probability of the 
in-control state, which was calculated in step (b), we decide 
that the process is in-control. Otherwise, we decide that the 
process is out-of-control. 

In the example, the generated random number (0.86565) is 
less than the probability of in-control state. Therefore, we 
decide the process is in-control state. 

(f) This step is the same as step (e), except it is for the 
Bayesian Control. Since the investigating criteria of the 
Bayesian Control are different from that of Markovian Control, 
the probability of the in-control state of the Bayesian Con- 


trol may be different from that of Markovian Control. 
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Therefore, the separated step was used in the simulation 
model. In the example, the result is the same as step (e). 

Then a cost report has to be generated for the simulation 
from the distribution of the state which was decided in step 
(e) and step (f). 

(g) This step is applied when the status of the process 

was decided as in-control state. A cost report is generated 
from the distribution of the in-control state. The distribu- 
tion of the in-control state is derived from the non-controlla- 
ble random deviation around the standard cost (uj)- Therefore 
it is appropriate to assume a normal distribution with standard 
cost aS a mean and a certain value derived from past experience 
as a standard deviation. 

A normal random number generator GGNML [9] is available 
in the IMSL library. But in this paper, a normal random 
number generator at the Naval Postgraduate School is used. 

The procedures for generating normal random number are 
as follow [10]; 

CALL OVFLOW 

CALL NORMAL (SEED,Z,A); 
where SEED is a seed to generate random numbers, Z 1s a 
single array variable that represents random number and A is 
a number that represents the number of random numbers to be 
generated. 

This randomnumber generator generates randomnumbers fromthe 


standard normal distribution (Normal (0,1)). Therefore we 
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have to transform the standard normal random number into the 


random number which comes from the distribution we assumed. 





=e 


Z(standard normal) = : L 


X(needed random number) = 4 + Zo. 


For example, we assume that a generated random number is 
1.0, then the actual random number (N.,) from the in-control 
state (N(100,5)) is 105 (N, = 100 + 51.0 = 105). Accordingly 
the cost report from the process is 105 for this period. 

Then we have to decide whether or not we should investi- 
gate the process based on the cost report. For this, the cost 
report 1s compared to the calculated control limit (Mo) Tig 
the cost report is less than the control limit (Mi), we decide 
that we should not investigate the process. Otherwise, we 
decide that an investigation is desirable. 

In this step, the process was in the in-control state. 
Therefore if we don't investigate, it doesn't incur any cost 
(Ci = 0), otherwise it incurs an investigation cost (Cy, = T) 
in addition to the cost report. 

For example, we assume the calculated control limit is 110. 
Then the cost report (105) is less than the control limit 
(110). Consequently, we decide not to investigate and the 
incremental cost 1S zero. 

If we investigate the process, we have to update the 
probability of an in=control state after investigation, to 


simulate the next period. Under Condition (1), which assumes 
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that the probability of an in-control state returns to one 
after an investigation, the probability of an in-control state 
is assigned to be one. Under Condition (2), which assumes 
that the probability of an in-control state doesn't return 
to one after an investigation, the probabiilty of an in- 
control state is assigned to be the probability of an in- 
control state at the end of the current period. 

Example: Investigation was conducted: Pu = 1 4Gondi tion 
(1)); Pa = Pu K€ond1 tion (2) )-; 


Investigation was not conducted: Pa = Pus 

(h) This step is applied when the process was decided as 
out-of-control. A cost report is generated from the distribu- 
tion of the out-of-control state. The distribution of the 
out-of-control state is derived from the controllable deviation 
around a certain expected value (Ho). It may Or may not be a 
normal distribution. In this paper, normal and gamma distri- 
butions were assumed. 

If it is assumed that the out-of-control state is a normal 
distribution, the procedure to obtain a random number is the 
same as in step (g). 

For example, if the distribution of the out-of-control 
state is N(120,5) and generated random number from N(0,1) is 
-1.0, then the random number to be used is 115 (Nu = 120 + 
§ x(-l1) = 115). Accordingly the cost report is 115 for this 
period. Then the same procedures as in step (g) are followed. 


For example, the cost report (115) is greater than the 


Gentrol limit (MA = 110). Consequently, we decide to investigate 
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the process. The process is in the out~of-control state. 
Therefore, the incremental cost for this period is (uo ~hy) 
~ (I +K): Cu = (120 -100) - (15 +5) = 0. 

The cost of not investigating the process is Ug “Hy 
because the process incurs cost Uo instead of Hy: In other 
words, we lose the Savings of Mo Thy because we do not inves- 
tigate the process. 

For the gamma distribution, the gamma random number 
generator GGMAR [9] is available in the IMSL library. The 
gamma random number generator at the Naval Postgraduate School 
is also used in this paper. 

The procedures are as follow: [11] 

CALL OVFLOW 

CALL GAMA (G,IX,X,N); 
where G is a gamma distribution parameter y, IX is a seed 
(integer), X is a single array variable that represents the 
gamma random numbers and N is a number that represents the 
number of random numbers to be generated. 

The random numbers generated from these procedures are 
the random numbers from the distribution of r(G,l). But we 
need random numbers generated from the assumed gamma distri- 
bution. Therefore we need transformation. 

For example, we assume a gamma distribution with the mean 
of 120 and the parameter i} of 1. Parameter y = 2 andi =l 
are chosen as a proper shape for the out-of-control state 
in this paper. Now we assume a random number generated from 


the r(2,1) is 1.50. Then the transformation is as follows: 
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a ae 
aoe wT Re var(x) = 4 = 2 = 2; 
A 
omer S +l? . 5X, “then Ey) = 85 + 17.5 «2 = ZO 
eee (17.5)* <2 = ameel. 5. 
Standard Deviation of Y = 24.75. 


Therefore, a needed random number is 116.25 (85 + 1.75 x1.5). 


(1) Now we turn to the Bayesian Control method. This step 
is applied when the process was decided to be in the in-control 
State. 

The procedures to generate a random number from the dis- 
tribution of the in-control state are the same as in step (g). 

Once a random number (cost report) was generated, then we 
have to figure out the posterior probability from the informa- 
tion of the cost report. Using Bayes' theorem, the posterior 


probability can be calculated as follows: 


fs) Ge le eo.) 
£(9,) Z £ (9, |x) 2 2 Ae 


2 
) £y(x] 05) £7 (0) 


I 


j=1 


where x is a cost report, fn fey) = gf} $91) and 
, ze het : ses 
fe (6) = ] £684? (Figure 2-3). 
We can obtain f(x] 05) from the normal distribution den- 


Prey eEUNneh 1 ON . 


2 
Z = s = r: where £(z) = i as [2 








Gy 





By the above two equations, we can calculate fy (x/ 65) 


and, in turn, we can calculate oe for a given cost report 








ors 
For example, if the generated random number was 105, 
then: 
_ 105 - 100 _ 105 - 120 
ay mai oe. lee a. = aa nie. ee Seen 
f(xje,) = Le’? = 0.242, 
J27 
f(x|e,) = ee = 0.0044, 
27 
= (0.9) (0.242) 
oe (0.9) (0.242) + (0.1) (0.0044) ee 


The revised probability of the in-control state (0.998) 
is greater than the breakeven probability (0.75). Therefore, 
we decide not to investigate the process and the incurred 
incremental cost of the process is zero. The revised proba- 


Igri y, £ (6 of this period becomes the beginning probability 


1? 
of the next period (D,, = Ppp = 0.98). Consequently, the prior 
probability will be 0.882 (0.98 x0.9) before generating a cost 
report for the next period. 

If we had investigated the process, the probability of 
the in-control state at the beginning of the next would have 
been set to "one" under Condition (1) and to the revised proba- 


bility of the current period under Condition (2) as the be- 


ginning probability of the next period. 
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For example: If an investigation was conducted; 


dW 
il 


i (Gena even (1) )7 

ions ee 

Pa = Par fe€ond meron (2). 

If an investigation was not conducted; 


t — 
Pp Par: 


(j) This step is executed when the process is determined 
Pompe OUE-Of-control. 

The procedures to generate a random number from the dis- 
tribution of the out-of-control state are the same as in 
step (h). We also calculate the revised probability by the 
same procedures as in step (1). 


For example, if the generated cost report was 116.25 





seep (h)), then; 
Beeeloezo O00 « ; wee Or CO 2 Oe ee 
aT Seas 5 Bre oi Z. ee aes On 5 
€(x]@,) = He 797°/* = 0.0020 
27 
E(x|@,) = e294 = 0.3011 
Y27 
(O20 02 Orr = AG 


is | (On002) (Ono) = (0. DaGaoonn) 


Based on this result, we decide to investigate the process. 
The incurred incremental cost of the process is (u5 “uy) - 
(I +K). For example, Cp = (Lo -u) - (1 +K) = (120 -100) - 
(15 +5) = 0. 

The steps explained above are the steps taken for one 


iteration of the simulation run. Each iteration puts out two 
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incurred incremental costs for the process, one for the 
Markovian Control (C,) and one for the Bayesian Control (C,). 

temecompake ENG Costs of Ehe Ewo moaels, a ditferential 
cost between the two models (C, - Cp) 1s calculated for each 
fmereration. 


The probability distribution of the calculated differ- 
ential cost between the two models is unknown. However, 
according to the central limit theorem; "as the sample size n 
increases, the distribution of the mean x of a random sample 
taken from practically any population approaches a normal 
distribution" [12], we can assume the sample means (X)) of 
the differential cost are normally distributed. 

We can obtain enough sample means to test the significance 
of the mean of sample means (X,) and can estimate the variance 
of the same means (Sg) 


With these values, we can carry out the test of hypotheses 


as follows: 


D M B. 
1 2 
X= = } X,) (n: number of iterations in each 
2 ae ae sample) 
Xp a =a X,  (m: number of samples), 
I= 
m _ 
2 al — =e 
Seda) Xa Se 
_ D D 
Xn ie j=1 : 


Then 
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ic = ——__—_ ; (uy > expected value of An) - 
D 


Based on this result, we can test the null hypothesis: 


there 1s no significant difference between the two models. 


If we accept Hos we say that there are no significant 
differences in performance betwen Markovian Control model 
and the Bayesian Control model under a given situation. 
Otherwise, we say that either one of the two methods performs 
better than the other under a given situation. 

In this paper, 100 iterations for each sample and 50 


samples are implemented. 
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APPENDIX B 
COMPUTER PROGRAMS 
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